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Abstract 

Spin models on quenched random graphs are related to many important op- 
timization problems. We give a new derivation of their mean-field equations that 
elucidates the role of the natural order parameter in these models. 
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Spin models on quenched random graphs have been studied extensively in 
recent years [1-5] for a couple of reasons. First, a large class of hard (and interesting 
in practice) optimization problems such as graph partitioning and graph colouring 
[6] can be formulated as a search for the ground state of such models. Their zero- 
temperature limit could thus yield valuable information on average properties of 
the optimal solutions. Second, for finite connectivity such models are closer to 
realistic systems than their infinite-range counterparts, yet mean-field theory is 
expected to stay exact. They thus provide a simpler setting in which to try to test 
whether the ultrametric structure and other properties of Parisi's solution of the 
spin-glass phase [7] survive for finite-range interactions. 

In this letter we would like to give a new derivation of the mean-field equations 
[4, 5] for such models. It is based on some simple arguments, well-known from 
the study of matrix models of 2d gravity [8, 9] and of the large-order behaviour 
of perturbative series [10], and adapted here in the context of disordered systems. 
Besides being simple and exact this novel derivation elucidates the role of the nat- 
ural order parameter in these models [4, 5]. It can be furthermore adapted readily 
to a variety of different situations. We will not address here the hard problem of 
solving these equations in the spin-glass phase. We will however comment briefly 
on the phase diagram in the case of pure ferromagnetic or antiferromagnetic cou- 
plings, as well as on the interpretation of the underlying graphs as infinite-genus 
triangulations. 

Consider first the ensemble of all trivalent ((f) 3 ) graphs made out of 2n vertices. 
If one ignores accidental-symmetry factors, the number of such graphs is given by 
the integral expression 



i r d\ r°° # 



Indeed the (^integral can be expressed as a sum over all topologically-distinct <p 3 
graphs weighted with / \# vertices ? times an inverse symmetry factor. The contour 
A-integral then picks out only the contribution of graphs with precisely 2n vertices. 
In the large-n limit we can evaluate this integral at the dominant non-trivial saddle 
points for both variables <p an d A. After a rescaling of variables (<p — > 4>/X) and 
some straightforward Gaussian integrations the result of the calculation reads: 

A/" n =^-J S~ n (-27mdetS"J (l + o(l/n)). (2) 
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Here S = \ — ^- is the rescaled "action" of the theory, S its value at the dominant 
non-trivial saddle point <p which solves the "field equation" 

if". 

and det S" is simply the second derivative of S at the saddle point. Eq. (2) is a 
standard result for the large-order behaviour of perturbative expansions [10], and 
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will stay valid in the more complicated cases studied below. In the case at hand, 
using (j) = 2, S = 2/3 and —S" = 1 one recovers the correct counting of large 
undecorated (p 3 graphs, whose precise number is M n = (|) ^ 6 ™2n)\" . 

Let us consider now an Ising model with spins, <7j = ±1, lying on the 2n 
vertices of a (j) 3 graph Q n . The partition function is 



z Q n h)= ex p J Yl a%o 3 + h cji ' ( 4 ) 

o"i,---, cr 2« y (ij) « y 

where the sums in the Boltzmann weight run over all edges and vertices respectively 
of the graph Q n , J is the spin-spin coupling and h a magnetic field. The average 
of the partition function over all graphs can be expressed as an integral [9] over a 
"field" defined on the discrete space {+, — }: 

where 

5=^^(A- 1 ) (JT T -^(e^ 3 + + e-V 3 -) , (6) 

<T,T 

and the 2x2 "propagator" matrix has entries 

A ff T = e 3ar ■ (7) 

Indeed, the weak- A expansion of the <p a integral (s) is given as before by the sum 
over (p 3 Feynman diagrams, while the A-integration forces the number of vertices to 
be 2n. For any given diagram the vertices are however now labelled by a "position 
in real space" cr, = ± . Furthermore there is a weight e hai for each vertex and 
a propagator e J(Ti(Tj for each edge. Summing over all "positions" of vertices thus 
yields the partition function of the Ising model on the corresponding graph. This 
justifies eq. (5). Note that the 4> a integral is strictly-speaking only defined through 
its asymptotic expansion. 

In the thermodynamic limit of large graphs (n — > oo) we can again calculate 
the above integral by the saddle-point technique. We limit ourselves for simplicity 
to the case of vanishing magnetic field. The action, eq. (6), has three non-zero 
saddle points, which after the usual rescaling read: 

C) 

and 
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Here g = e 2J , so that g e [ 1, oo) corresponds to ferromagnetic couplings J > 0, 
while <7 G [ 0, 1] to antiferromagnetic couplings J < 0. The (degenerate) saddle 
points, eq. (9), dominate in the low-temperature ferromagnetic region g > 3, 
but become complex below (7 = 3, where the saddle point (8) takes over. This 
latter can be continued analytically all the way down to g = 0, i.e. to the zero- 
temperature antiferromagnet. The transition at g = 3 corresponds in fact to the 
onset of ferromagnetic order. This can be seen from the expression for the average 
(annealed) magnetization: 



1 d 



Mann - = 2^dh logZGr: 



= ft-f- = J*iWS?. if ^ >3; do) 

h =o (f>+ + (f>- [0, if#<3 



which follows by straightforward manipulations. For completeness we give also 
the result for the average partition function, valid up to terms of order o(l/n): 

logZ^Jg)\ h=Q = -nlog \s-\ log (- det (AS")) (11) 
-nlog^-flogfg, if<7<3; 
_ n l og 3^ + Jiogn + log(r(J) (|) 1/4 /v^), if ^ = 3; 

Note that the logarithmic corrections at the critical point are due to the appearance 
of a zero mode, so that in the calculation of the integral we must keep terms higher 
than quadratic in the action. These logarithmic corrections are a manifestation 
of the long-range order. Note also that in the ferromagnetic region we took into 
account only one of the two saddle points, corresponding to a pure thermodynamic 
state. 

Up to now we treated the random graphs as annealed disorder, meaning that 
they were allowed to participate in the dynamics on an equal footing with the 
Ising spins. We can quench them by employing the replica trick 

- 1 

XogZ = lim — . (12) 

k^o k 

To this effect we introduce a real field with argument on the hypercube in k 
dimensions, (^>({cr}) = ^ (cr 1 , . . . , a fc ) . Each vertex of a Feynman diagram will 

now be labelled by the values of k distinct spins, one for each replica 1 ^ . Arguing 
as before we can express the kth moment of the Ising partition function in zero 
magnetic field as follows: 



^ Note that upper indices label the replicas. They should not be confused with lower indices which 
label the 2n vertices of a graph. 
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with 

s = \ E ^(wjA-Hw-wj^D-^E^w) 3 - (14) 

Here X^o-} stands for a sum over all possible values of the k spins cr a , and the 
2 fc x 2 k propagator matrix has entries corresponding to the Boltzmann weight 
of k non-interacting replicas on an edge, A({cr},{r}) = exp ( J J2 a a a r a ). More 
generally we may allow a propagator 

A(W,{r}) = J dJp(J)e J T. a ^ a , (15) 



which amounts to choosing uncorrelated couplings on each edge with some (ar- 
bitrary) distribution p(J). We may also trade the ^(p 3 interaction for a more 

general monomial A M , (j) M so as to obtain graphs with fixed connectivity equal 
to M. Extremizing the (rescaled) action yields finally the saddle-point equations 



HW}) = Jm^V), E A (W, W) HiT})™- 1 • (16) 

{ T } 

The calculation of integer moments of the partition function is thus reduced in the 
thermodynamic limit to a finite algebraic problem. 

In order to quench the random graphs we of course still have to continue 
analytically to values of k near zero. To do this one must make an ansatz on 
the precise pattern of replica-symmetry breaking. Full symmetry for instance 
would imply that the field only depends on the fraction of replicas pointing up: 
<^>({cr}) = (^(a 1 + • ■ • + a fc ) . A first stage of hierarchical breaking on the other hand 

would correspond to the ansatz: 0({cr}) = </>(cr 1 H her™ , . . . , cr k ~™ +1 -\ \-a k ). 

Details on the k — > continuation as well as on the resulting free energy can be 
found in refs [4, 5]. Here we would only like to point out that the order parameter 
4> ({<?}) can be related to the more standard magnetization overlaps by the same 
kind of argument that lead us to eq. (10). Indeed the fraction of vertices with a 
given value {a} for the spins of the k replicas can be easily seen to be proportional 

to 0({<7» . The definit ion of the magnetization overlaps on the other hand is 

Q ai - ae = lim fE^H?) , (17) 
n^oo zn — 

i 

where (A) denotes the thermal average, while A 

stands for the average over the quenched disorder. It follows by straightfor- 
ward manipulations that 

Q ai - ae = ^ = — V, ' ■ (18) 

E M 0(W) M 
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Our derivation of equations (16) and (18) is the main point of this letter. 
Equations (16) had been derived previously for spin models on the Bethe lattice 
[11], and were later argued to hold for random graphs [4] because such graphs 
have a tree-like local structure. In [4, 11] the relation of 0({u}) to the overlaps 
differs however from eq. (18). It is conceivable that this difference can be traced 
to the effect of finite loops that are ignored in these references. In any case, 
besides being exact, our novel derivation elucidates the role of the natural order 
parameter 0({cr}) in such models. As we have shown, it is the field generating the 
diagrammatic expansion, and whose mean-field equations yield the instanton that 
governs the behaviour of this expansion at large orders. 

The above analysis can be extended easily to several different contexts. To- 
gether with the constraint Q a = Va, eqs (16) are for instance the mean-field 
equations for the graph bipartitioning problem [3, 6]. Fluctuating connectivity 
can be also accomodated if we trade the monomial interaction with a more gen- 
eral potential V(\(fi)/\ 2 . The saddle-point equations then read 



0(M)=£A(M,{t})F'(0({t})) , (19) 

M 

where V denotes the derivative of V. Note that the A-integration fixes now the 
difference of the numbers of edges and vertices. Other constraints can be imposed 
by extra contour integrations. Eqs (19) with an exponential potential V = - — - — 
have been also obtained by De Dominicis and Mottishaw [5] in the case of an 
ensemble of graphs where the connectivity is a random variable with Poissonian 
distribution of average a. Finally, as it should be evident, Potts or continuous spins 
can be introduced by letting the argument of the field cf> live on the corresponding 
space. 

In the special case of fixed ferromagnetic or antiferromagnetic coupling J, 
the mean-field equations (16) with M = 3 admit an obvious set of (factorized) 
solutions 

4>({a}) = 2 1 - k 4> ai ...4> ak , (20) 

where each factor on the right-hand side stands for (any) solution of the k = 1 
(annealed) problem. When the saddle point (20) dominates, both the overlaps 
and the leading exponential piece of Zg factorize, so that despite the average 

over graphs the replicas are completely decorrelated^-*. Continuing k — > one 
finds a quenched free energy equal to the annealed one, eq. (11), up to finite-size 



^ Decorrelated groups of replicas would correspond more generally to a product solution ^>({<r}) = 
2 1 ~ m (f>( kl j ■■■4>(k m ) > where 4>(k v ) ls anv solution of the saddle-point equations with fc„ replicas and 

E m k v =k. Such solutions break the symmetry of replicas and are never dominant for integer k. 
v= l 
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corrections^). The corresponding entropy per spin is 



| log 
3 log 



3ff 



2(3+1) 



( g -l)"( g +l) 
ff-2 



log#, 

3g(g 2 -2g-l) 
2(9-2)( 9 -l)(s+l) 



log£f, 



if fir < 3; 
if <7>3. 



(21) 



It becomes negative below g ~ 0.211, signaling the existence of a phase transition 
in the low-temperature antiferromagnetic region. This is also confirmed by an 
analysis of the moments Zg of the partition function. By solving completely 
equations (16) (M = 3) for k = 2, 3 and 4 we have found transition points 

0.187 and g^ ~ 0.205, below which the factorizable saddle 



o (2) 

9c 



0.172, gi 3) 



point (20) ceases to dominate, so that lim n ^ 00 ^ log Zg k ^ lim^^oo ^ log Zg n . 
This situation is reminiscent of the random-energy model [12], except that the 
critical temperatures seem to accumulate to a finite value (g < 1). The nature 
of this low-temperature phase deserves some further study. Indeed, although the 
couplings are purely antiferromagnetic, there is both frustration and disorder since 
the random graph has loops of arbitrary size. 

We conclude with some comments on the interpretation of random graphs as 
infinite-genus triangulations. This comes about by considering the real field as a 
N xN hermitean matrix with N = 1, so that our ensemble consists of "fat" graphs 
Q n or dual triangulations [8] weighted equally for all genera. The average Euler 
characteristic can be computed easily by taking a derivative with respect to the 
size N of the hermitean matrix with the result: 



X = —n + log 6n — 



<9iogr(x) 



<91og£ 



(22) 



x=l 



Note that since for vacuum (p 3 graphs with 2n vertices x = — n + # faces , an 
average graph in this ensemble has a maximal density of handles. Though rather 
singular, this 2d surface interpretation allows a mapping of the Ising model on Q n , 
onto a model with spins lying on the vertices of the dual triangular net Q*. This 
duality is implemented by a linear transformation of the fields that diagonalizes 
the quadratic part of the action. For k = 1 for instance the action would take the 
form 



(ft 



+ ft_ - 



A 
2 
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with 
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9 + 1 



(23) 



(24) 



Since the propagator is now diagonal, we can assign a sign ± to each edge of 
the (f) s graph, or equivalently to the dual edge (ij) on the triangular lattice Q*. 



It can be verified more generally under the assumption of replica symmetry that the factorized 
solution (20) is indeed dominant in the k — >0 limit. 
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We interpret this sign as the value of o~i<jj, where the ex's now stand for the spins 
residing on the vertices of the triangular lattice. The product of three signs around 
a triangle should be +, consistently with the fact that only two kinds of vertices 
survive in the action (23). Furthermore, there is an extra weight g when all 
three spins around the triangle are aligned. As can be verified easily, the duality 
transformation (24) maps the high- and low-temperature ferromagnetic regions of 
the Ising models on Q n and to one another. The fact that mean-field theory 
is exact can be understood in the dual language as a consequence of the fact that 
the number of vertices grows only logarithmically with n, while the connectivity 
is extensive. Note finally that the antiferromagnetic region on C/* corresponds to 
3 G [0,1), and is mapped onto the interval (— oo, —1] . The analysis of the moments 
and entropy shows no signal for a phase transition in this region. 
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